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Abstract 

We use methods of the general theory of congruence and *congru- 
ence for complex matrices — regularization and cosquares — to determine 
a unitary congruence canonical form (respectively, a unitary *congruence 
canonical form) for complex matrices A such that A A (respectively, A^) 
is normal. 

As special cases of our canonical forms, we obtain — in a coherent and 
systematic way — known canonical forms for conjugate normal, congruence 
normal, coninvolutory, involutory, projection, A-projection, and unitary 
matrices. But we also obtain canonical forms for matrices whose squares 
are Hermitian or normal, and other cases that do not seem to have been 
investigated previously. 

We show that the classification problems under (a) unitary *congru- 
ence when A^ is normal, and (b) unitary congruence when AAA is normal, 
are both unitarily wild, so there is no reasonable hope that a simple solu- 
tion to them can be found. 



1 Introduction 

We use methods of the general theory of congruence and *congruence for com- 
plex matrices — regularization and cosquares — to determine a unitary congru- 
ence canonical form (respectively, a unitary *congruence canonical form) for 
complex matrices A such that AA (respectively, A'^) is normal. 

We prove a regularization algorithm that reduces any singular matrix by 
unitary congruence or unitary *congruence to a special block form. For matrices 
of the two special types under consideration, this special block form is a direct 
sum of a nonsingular matrix and a singular matrix; the singular summand is a 
direct sum of a zero matrix and some canonical singular 2-by-2 blocks. Analysis 
of the cosquare and *cosquare of the nonsingular direct summand reveals 1-by-l 
and 2-by-2 nonsingular canonical blocks. 
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As special cases of our canonical forms, we obtain — in a coherent and sys- 
tematic way — known canonical forms for conjugate normal, congruence nor- 
mal, coninvolutory, involutory, projection, and unitary matrices. But we also 
obtain canonical forms for matrices whose squares are Hermitian or normal, 
A-projections, and other cases that do not seem to have been investigated previ- 
ously. Moreover, the meaning of the parameters in the various canonical forms 
is revealed, along with an understanding of when two matrices in a given type 
are in the same equivalence class. 

Finally, we show that the classification problems under (a) unitary '''congru- 
ence when is normal, and (b) unitary congruence when AAA is normal, are 
both unitarily wild, so there is no reasonable hope that a simple solution to 
them can be found. 

2 Notation and definitions 

All the matrices that we consider are complex. We denote the set of n-by-n 
complex matrices by M„. The transpose of ^ = [o-ij] G is A'^ — [aji] and the 
conjugate transpose is A* = = [a^i]; the trace of A is tr^ = an -|- • • • -|- a„„. 

We say that A e M„ is: unitary if A* A — /; coninvolutory if AA = /; 
a X-projection if = \A for some A £ C {involutory if A = 1); normal if 
A* A = AA*; conjugate normal if A* A = AA*; squared normal if A^ is normal; 
and congruence normal if AA is normal. For example, a unitary matrix is both 
normal and conjugate normal; a Hermitian matrix is normal but need not be 
conjugate normal; a symmetric matrix is conjugate normal but need not be 
normal. 

If A is nonsingular, it is convenient to write A^'^ = {A^^)'^ and A^* = 
{A^^)*; the cosquare of A is A~'^A and the *cosquare is A^*A. 

We consider the congruence equivalence relation {A — SBS"^ for some non- 
singular S) and the finer equivalence relation unitary congruence {A = UBU"'" 
for some unitary U). We also consider the * congruence equivalence relation 
{A = SBS* for some nonsingular S) and the finer equivalence relation unitary 
*congruence {A = UBU* for some unitary U). Two pairs of square matri- 
ces of the same size (A, B) and (C, D) are said to be congruent, and we write 
{A,B) = S{C,D)S'^, if there is a nonsingular S such that A = SBS'^ and 
C = SDS"'"; unitary congruence, * congruence, and unitary * congruence oi two 
pairs of matrices are defined analogously. 

Our consistent point of view is that unitary *congruence is a special kind of 
^congruence (rather than a special kind of similarity) that is to be analyzed with 
methods from the general theory of *congruence. In a parallel development, we 
treat unitary congruence as a special kind of congruence, rather than as a special 
kind of consimilarity. 'E^, Section 4.6] 

The null space of a matrix A is denoted by N{A) = {x e C" : Ax — 0}; 
dimN{A), the dimension of N{A), is the nullity of A. The quantities dimN{A), 
dim7V(^^), dim {N (A) DNiA^)), dimN{A*), and dim{N(A) D N{A*)) play 
an important role because of their invariance properties: dimiV(^), dim N{A'^), 
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and dim {N{A) n N{A'^)) are invariant under congruence; dim N{A), dimN{A*), 
and dim {N{A) n N{A*)) are invariant under ^congruence. 

Suppose A, ?7 e Mn and U is unitary. A computation reveals that if A is 
conjugate normal (respectively, congruence normal) then U AU^ is conjugate 
normal (respectively, congruence normal); if A is normal (respectively, squared 
normal) then UAU* is normal (respectively, squared normal). Moreover, if 
A e Mn and B G M^, one verifies that A® B is, respectively, conjugate 
normal, congruence normal, normal, or squared normal if and only if each of A 
and B has the respective property. 

Matrices A, B of the same size (not necessarily square) are unitarily equiva- 
lent if there are unitary matrices V, W such that A = VBW . Two matrices are 
unitarily equivalent if and only if they have the same singular values, that is, 
the singular value decomposition is a canonical form for unitary equivalence. 

Each A G Mn has a left (respectively, right) polar decomposition A = PW 
(respectively, A — WQ) in which the Hermitian positive semidefinite factors 
P = {AA*y/^ and Q = {A*Ay^'^ are uniquely determined, W is unitary, and 
W = AQ~^ = P~^A is uniquely determined if A is nonsingular. 

A matrix of the form 



Jfe(A) = 



A 1 







1 
A 



e Mk 



is a Jordan block with eigenvalue A. The n-hy-n identity and zero matrices are 
denoted by /„ and 0„, respectively. 

The Frobenius norm of a matrix A is = -^/tr {A* A): the square root 

of the sum of the squares of the absolute values of the entries of A. The spectral 
norm of A is its largest singular value. 

In matters of notation and terminology, we follow the conventions in [8]. 



3 Cosquares, *cosquares, and canonical forms 
for congruence and * congruence 

The Jordan Canonical Form of a cosquare or a *cosquare has a very special 
structure. 

Theorem 3.1 ([13], [24l Theorem 2.3.1]) Let a e A/„ be nonsingular. 
(a) ^ is a cosquare if and only if its Jordan Canonical Form is 

{jr. (^^^ (^^-^ ® '^^^ (^^')) ' 7, G ^ 7, ^ (-1)^^+^ 

k=i j=i 

(1) 
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21 is a cosquare that is diagonalizahle by similarity if and only if its Jordan 
Canonical Form is 



700 







^^J'In, 



i-ij e c, 7^ ^ 1, 



(2) 



in which /zi, /LtJ"^, . . . , /Xq, are the distinct eigenvalues of such that each 
jjLj ^ 1; ni,ni, . . . ,nq,nq are their respective multiplicities; the parameters /ij 
in 0) are determined by 21 up to replacement by I^J^ ■ 

(b) % is a *cosquare if and only if its Jordan Canonical Form is 

P a 

0^r.(/3fe)®0(Js,(7,)®^(77')), /3fe,7, eC, |/3fe| = l, 0<|7j|<l. 
fe=i i=i 

(3) 

21 is a *cosquare that is diagonalizahle by similarity if and only if its Jordan 
Canonical Form is 



k=l 



l^jln, 
/27'/„ 



\k,^lJ e c, lAfcl = 1, < ImjI < 1, (4) 



in which fii, p,^^ , . . . , fj,q, fi^^ are the distinct eigenvalues of ^ such that each 
\fj-j\ € (0,1); ni, ni, . . . , rig, Tig are their respective multiplicities. The distinct 
unimodular eigenvalues of ^ are Ai,...,Ap and their respective multiplicities 
are toi, . . . , rUp. 

The following theorem involves three types of blocks 

"0 



Tk = 



(„l)fc+r 
(-1)'= 



1 

-1 -1 
1 1 



e Mk, (Fi = [1]), 



(5) 



and 



At 



H2kil^) 





1 

1 i 



Ik 
Jkili) 



e Mk, (Ai = [1]), 



1 
/I 



)• 



(6) 



(7) 



Theorem 3.2 ([13]) Let A e M„ be nonsingular. 

(a) A is congruent to a direct sum, uniquely determined up to permutation of 
summands, of the form 



0r.. ® 0i?2s, (7,) , 7, e c, ^ 7, ^ (-i)^^+\ 



(8) 



k=l 
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in which each jj is determined up to replacement by 7^ ^. If (QP is the Jordan 
Canonical Form of A~'^ A, then the direct summands in (0) can he arranged 
so that the parameters p, a, r^, Sj, and 7j in are identical to the same 
parameters in (OJ). Two nonsingular matrices are congruent if and only if their 
cosquares are similar. 

(b) A is * congruent to a direct sum, uniquely determined up to permutation of 
summands, of the form 

p a 

0afeA„, ® 0i?2m, (7j) , afe,7j G C, |afc| = 1, < |7,| < 1, (9) 
k=\ j=i 

If (0) is the Jordan Canonical Form of A^*A, then the direct summands in (0) 
can be arranged so that the parameters r^, Sj, and "fj in are identical to 
the same parameters in Q), and the parameters ak in @) and [3k in satisfy 
al = 13k for each k — 1, . . . ,r. 

Among many applications of the canonical form ([9]), it follows that any 
complex square matrix is ^congruent to its transpose, and the *congruence can 
be achieved via a coninvolutory matrix. This conclusion is actually valid for 
any square matrix over any field of characteristic not two with an involution 
(possibly the identity involution), [llj 

If A is nonsingular and U is unitary, then 

{UAU^y^ {UAU'^) = U (A'^'^A) U* 

and 

{UAU*r* (UAU*) = U {A-*A) U*, 

so a unitary congruence (respectively, a unitary ^congruence) of a nonsingu- 
lar matrix corresponds to a unitary similarity of its cosquare (respectively, 
*cosquare), both via the same unitary matrix. If the cosquare or *cosquare 
oi A € Mn is diagonalizable by unitary similarity, what can be said about a 
canonical form for A under unitary congruence or unitary *congruence? 

4 Normal matrices, intertwining, and zero blocks 

Intertwining identities involving normal matrices lead to characterizations and 
canonical forms for unitary congruences. 

Lemma 4.1 Let A,L,P^ Af„ and assume that L and P are normal. Then 

(a) AL ^ PA if and only if AL* = P* A. 

(b) If L and P are nonsingular, then AL = PA if and only if AL~* — P~* A. 

Proof. Let L = U AC/* and P — VHV* for some unitary U, V and diagonal 
A,n. The intertwining condition AL — PA implies that Ag{L) — g{P)A for 
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any polynomial g{t). 

(a) Let g{t) be any polynomial such that g{A) = A and .g(n) = fl, that is, g{t) 
interpolates the function z z on the spectra of L and P. Then 

AL* = Ag{L) = g{P)A = P*A. 

(b) Use the same argument, but let g{t) interpolate the function z — > z~^ on 
the spectra of L and P. ■ 

The following lemma reveals fundamental patterns in the zero blocks of a 
partitioned matrix that is normal, conjugate normal, squared normal, or con- 
gruence normal. 

Lemma 4.2 Let A e M„ be given, 
(a) Suppose 

. _ r ^11 Ai2 
[ A22 

in which Au and A22 are square. If A is normal or conjugate normal, then 



All 






A22 



If A is normal, then An and A22 are normal; if A is conjugate normal, then 
All and A22 are conjugate normal. 

(b) Suppose 

~ All A12 
A21 A22 A23 
Ofc 

in which An and A22 are square, and both [An A12] and A23 have full row 
rank. If A is squared normal or congruence normal, then 



(10) 



A 



An 
A23 
Ofc 



and An is nonsingular. If A is squared normal, then An is squared normal; if 
A is congruence normal, then An is congruence normal. 



Proof, (a) If A is normal, then 
A*A 



A*nAn 
* 



* 
* 



AiiA*n + Ai2A\2 * 
* ★ 



AA*. 



We have A\^An = AnAl^+Ai2Al^, so tr (Al^An) ^ tr (An tr (AnAl^) 



tT{Ai2Al^). Then tr(Ai2At2) = \\Al4'p 
AiiAn. If A is conjugate normal, then 



0, so A12 = and Al^An 



A* A = 



A*iiAn 
★ 



* 
★ 



AiiAli + A12AI2 * 
* ★ 



AA*. 
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We have tr (Al^An) = tr (An = tr [AnAl^] 

|2 



^tr(Ai2At2),so tr (AiaA^a) 



lA^all^ = 0. Then A12 



and Ali^ii = AiiA^n 



(b) Compute 



* * A12A23 
Ok 



and AA 



* * ^12^23 

* ★ ^422^23 

Ok 



(11) 



If A is squared normal (or congruence normal), then (a) ensures that both 
A12A23 and A22A23 (or both A12A23 and A22A23) are zero blocks; since A23 
has full row rank, it follows that both A\2 and A22 are zero blocks and hence 



A 



An 
A21 A23 
Ofc 



in which An is nonsingular. Now compute 







^11 
A2iAn 



Ok and AA = 



An An 
AaiAn 



'0, 



If A is squared normal (or if A is congruence normal), then (a) ensures that 
A21A11 = (or that A21A11 = 0); since An is nonsingular, it follows that 
A21 — and An is squared normal (or congruence normal). ■ 

A matrix A e M„ is said to be range Hermitian if A and A* have the same 
range. If rank A = r and there is a unitary U and a nonsingular C € Mr such 
that U*AU = C©0„_r, then A is range Hermitian; the converse assertion follows 
from Theorem I6.1f b). For example, every normal matrix is range Hermitian. 
The following lemma shows that, for a range Hermitian matrix and a normal 
matrix, commutativity follows from a generally weaker condition. 

Lemma 4.3 Let A, _B G Af„. Suppose A is range Hermitian and B is normal. 
Then ABA = A^B if and only if AB = BA. 

Proof. If AB = BA, then A{BA) = A{AB) = A^B. Conversely, suppose 
ABA = A^B. Let A = U{C®On~r)U* , in which J7 e M„ is unitary and C € Mr 
is nonsingular. Partition the normal matrix U*BU 
C®On-r- Then 



[Bij]ij=i conformally to 



U*{ABA)U = {U*AU)iU*BU){U*AU) 



' c 


■ 




■ Bn 


B12 




■ C 


■ 












B21 


B22 













and 



U*{A^B)U = {U*AUf{U*BU) 



' C2 


■ 




■ fill 


B12 












B21 


B22 





C'Bn 




CBiiC 




C B12 
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so C^Bi2 — 0, which impHes that B12 = 0. Lemma l¥^ a) ensures that B21 = 
as well, so U*BU = Bn e B22. Moreover, CBnC = C^Bn, so BuC = CBu. 
We conclude that U*AU commutes with U*BU, and hence A commutes with 
B. u 



5 Normal cosquares and *cosquares 

A nonsingular matrix A whose cosquare is normal (respectively, whose *cosquare 
is normal) has a simple canonical form under unitary congruence (respectively, 
under unitary ^congruence). Moreover, normality of the cosquare or *cosquare 
of A is equivalent to simple properties of A itself that are the key — via regularization — 
to obtaining canonical forms under unitary congruence or unitary *congruence 
even when A is singular. 



5.1 Normal cosquares 

If A S M„ is nonsingular and its cosquare 21 is normal, then 21 is unitarily 
diagonalizable and we may assume that its Jordan Canonical Form has the form 
For our analysis it is convenient to separate the eigenvalue pairs { — 1, —1} of 
21 from the reciprocal pairs of its other eigenvalues in ([2]). Any unitary similarity 
that puts 21 in the diagonal form ([2|) induces a unitary congruence of A that 
puts it into a special block diagonal form. 



Theorem 5.1 Let A G Af„ be nonsingular and suppose that its cosquare 21 
A^"^A is normal. Let ni, /ij"^, . . . , jiq, /i^ 
— ly^fijy^l for each j = 1, . . . ,q, and let ni, rti 
multiplicities. Let n+ and 2n-be the multiplicities of +1 and —1, respectively, 
as eigenvalues o/2l. Let 



^ be the distinct eigenvalues of 21 with 
Uq , Uq be their respective 



A = /„^ e (-^2n_) ©0 











fl.y^O, - 1 ^ /ij ^ I, (12) 



let U G Mn be any unitary matrix such that 21 
Then 

^ = ^+ e ^- ® ^1 ® • • 



UAU*, and let A = U'^ AU . 



>Aq, 



(13) 



in which A+ G is symmetric, A- G Af2n_ is skew symmetric, and each 

Aj G has the form 



A,= 



Yj G Mnj is nonsingular. 



(14) 



The unitary congruence class of each of the q + 2 blocks in m3\) is uniquely 
determined. 
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Proof. The presentation (|l'2p of the Jordan Canonical Form of 21 differs from 
that in ([2]) only in the separate identification of the eigenvalue pairs {—1,-1}. 
We have A = A'^Sl = A^UAU*, which impHes that 

A = U^AU = U^A'^UA = A^A 



and hence 



that is, 



A = A^A = {A^Af A = AAA, 



A-^A = AA. 



(15) 



Partition A — [-^ijli^^i conformally to A. The q 



_^ v^vjiii^^i iiicoiij ji. iii^ y I 2 diagonal blocks of A have 
mutually distinct spectra; the spectra of corresponding diagonal blocks of A and 
A""'^ are the same. The identity (fT5|) and Sylvester's Theorem on Linear Matrix 
Equations [HI Section 2.4, Problems 9 and 13] ensure that A is block diagonal 
and conformal to A, that is. 



A = An 



>A^ 



9+2.9+2 



is block diagonal. Moreover, the identity A — A^A ensures that (a) An — An, 
so A+ := An is symmetric; (b) .422 = -^A22, so A- := A22 is skew symmetric; 
and (c) for each i = 3, . . . ,q + 2 the nonsingular block Ajj has the form 



X Y 
Z W 



X,Y,Z,WeMn, 



and satisfies an identity of the form 



" X 


Y 




■ X 


Y 


T 


' ni ■ 




z 


w 




z 


w 




fi-^I 





^lY^ ii-^w^ 

in which ^ 1. But X = fiX'^ = pi'^X and W = n'^W'^ = fJ.^'^W, so 
X = W = 0. Moreover, Z = ^lY"^ , so Ajj has the form (fTi)) . 

What can we say if 21 can be put into the form (|12p via unitary similarity 
with a different unitary matrix V7 If 21 = UAU* = VAV* and both U and 
V are unitary, then A{U*V) — {U*V) A, so another apphcation of Sylvester's 
Theorem ensures that the unitary matrix U*V is block diagonal and conformal 
to A. Thus, in the respective presentations (fT3|) associated with U and V, 
corresponding diagonal blocks are unitarily congruent. ■ 

Theorem 5.2 Let A £ Mn- The following are equivalent: 

(a) A A is normal. 

(b) A (XF) = (WA) A, that is, AAA^ = A^ AA. 

If A is nonsingular, then (a) and (b) are equivalent to 

(c) A~'^ A is normal. 
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Proof, (a) (b): Consider the identity 

A {AA) = AAA = {AA) A. 



Since AA is normal, AA — {A A) is normal and Lemma [4. If a) ensures that 

A {AA)* = AA*A^ = A^A*A = {AA)* A. 

Taking the transpose of the middle identity, and using Hermicity of AA* and 
A* A, gives 

A {AA*f = A (XF) = (M) A = {A*Af A. 

(b) =4> (a): We use (b) in the form AA*A'^ = A^ A* A to compute 

{AA) {AA)* ^ A {AA*A^) = A {A^A*A) , 

so AA^A*A is Hermitian: 

(AA) (AA)* = AA^A*A = (AA^AM)* 

= A* (AAA^) - A* (A^AA) - (AA)* (AA) . 

(c) =^ (b): Consider the identity 

A(A-^A) = AA-^A = (A-^A)-^A. 

Since A^'^A is normal. Lemma l4TT b') ensures that 

A(A-^A)-* = ((A-^A)-^)"* A = (A-^A)A, 

so AAA^* = A"* A A, from which it follows that A* A A = AAA*, which is the 
conjugate of (b). 

(b) ^ (c): Since A is nonsingular, the identity (b) is equivalent to 

A^AA = (A^A*A)^ = (AA*A^)^ = AAA^, 
which in turn is equivalent to 

AA-^A-i = A-^A-^A. 

Now compute 

{A-^A){A-^A)* = A-^ (AA*) A'^ = A"^ (A^A*AA-^) A'^ 

= A* (AA-'^A-i) = A* (A-^A-'^A) = (A-'^A)*(A-^A). 
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Theorem 5.3 Let A G he nonsingular. If AA is normal, then A is unitarily 
congruent to a direct sum of blocks, each of which is 



1 




cr>0, T>0, fieC,0^ fi^l. 



(16) 



This direct sum is uniquely determined by A up to permutation of its blocks and 
replacement of any fi by Conversely, if A is unitarily congruent to a direct 
sum of blocks of the two types in HI 6]) . then AA is normal. 



Proof. Normality of AA implies normality of the cosquare A^'^A. Theorem 
15.11 ensures that A is unitarily congruent to a direct sum of the form (|13p , and 
the unitary congruence class of each summand is uniquely determined by A. It 
suffices to consider the three types of blocks that occur in : (a) a symmetric 
block A+ , (b) a skew-symmetric block A- , and (c) a block of the form (|14p . 



(a) The special singular value decomposition available for a nonsingular sym- 
metric matrix 8, Corollary 4.4.4] ensures that there is a unitary V and a positive 
diagonal matrix E — diag(CTi, . . . , (t„^) such that A+ = VT.V'^ . The singular 



values CTi of A-^- are the source of all of the 1-by-l blocks in p^ . They are 
unitary congruence invariants of A+, so they are uniquely determined by A. 

(b) The special singular value decomposition available for a nonsingular skew- 
symmetric matrix [8, Problem 26, Section 4.4] ensures that there is a unitary V 
and a nonsingular block diagonal matrix 





■ 1 ■ 




■ 1 " 




-1 




-1 



(17) 



such that A- = VT,V'^. These blocks are the source of all of the 2-by-2 blocks in 
(|16p in which /i = — 1 . The parameters ti^ti, . . . ,t„_,t„_ are the singular values 
of A~ , which are unitary congruence invariants of A- , so they are uniquely 
determined by A. 



(c) Consider a block of the form 



Aj — 



in which Yj € M„ . is nonsingular. The singular value decomposition [8', Theo- 
rem 7.3.5] ensures that there are unitary Vj, Wj G Af„^. and a positive diagonal 
matrix T,j = diag(T} 



(i) 



T^]^ ) such that Yj 



Then 







is unitarily congruent to 












" ■ 


























w, _ 
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which is unitarily congruent (permutation similar) to 

i=l 

These blocks contribute nj 2-by-2 blocks to (fTB|) . all with fj, ~ fij. Given /ij 7^ 0, 
the parameters r^-* , . . . , rif are determined by the eigenvalues of AjAj , which 
are invariant under unitary congruence of Aj . 

Conversely, if A is unitarily congruent to a direct sum of blocks of the form 
(fT6|) . then AA is unitarily similar to a direct sum of blocks, each of which is 

[a2]orrV2, 7^/1^1, 
so AA is normal. ■ 



1 




rp' > 0. 



5.2 Normal *cosquares 

If A G Mn is nonsingular and its *cosquare 2t is normal, we can deduce a unitary 
*congruence canonical form for A with an argument largely parallel to that in 
the preceding section, starting with the Jordan Canonical Form ([4]). We find 
that any unitary similarity that diagonalizes 2t induces a unitary *congruence 
of A that puts it into a special block diagonal form. 

Theorem 5.4 Let A G Af„ be nonsingular and suppose that its *cosquare 
21 = A~* A is normal. Let fii, p,^^ , . . . , fiq, fl~^ be the distinct eigenvalues of 
2t with < I < 1 for each j = 1, . . . , g, and let ni , ni , . . . , n^, be their 
respective multiplicities. Let Ai,...,Ap be the distinct unimodular eigenvalues 
of with respective multiplicities mi, . . . , nip, and choose any unimodular pa- 
rameters ai, . . . , ap such that ce^ — Xk for each k = \, . . . ,p. Let 



k=i j=i 



tijln, 









Afe,/ij G C, \\k\ = 1, < < 1, 



let U G Mn be any unitary matrix such that 21 
Then A is block diagonal and has the form 



(18) 

UKU*. and let A = U*AU. 



A = aiHi ' 



' apTLp Ai 



in which TLk G M^^^ is Hermitian for each k 
has the form 



®Aq, (19) 

,p, and each Aj G M2nj 



A,= 







Yj G is nonsingular. 



(20) 



For a given ordering of the blocks in I118\) the unitary *congruence class of each 
of the p + q blocks in I119\) is uniquely determined. 
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Proof. We have A = A*^ = A*UMJ*, which imphes that 

A ^ U*AU = U*A*UA = A* A 



and hence 
that is, 



A = A*A = {A*A)* AAA, 
A^^A = AA. 



(21) 



Partition A = [Aij]^j^-^ conformaUy to A. The p + q diagonal blocks of A 
have mutually distinct spectra; the spectra of corresponding blocks of A and 
A~^ are the same. The identity (PT|) and Sylvester's Theorem on Linear Matrix 
Equations ensure that A is block diagonal and conformal to A, that is, 



A = An 



pp ' 



> A 



■P+i,P+i 



>A. 



p+q,p+q 



is block diagonal. Moreover, the identity A = A* A ensures that Akk = ^kA^i. 
al^l^, so if we define Hk ■= OkAkk, then 

Hk a^Akk = '^cil^kk = "fc-^fefe = {okAkk) 



so Hk is Hermitian. For each j = p + 1, 



Hk, 

p + q the block Ajj has the form 



X Y 

z w 



and satisfies an identity of the form 



" X 


Y 




■ X 


Y 




' fii ■ 




z 


w 




z 


w 




p,-^i 





fiX* 
fiY* 



^Z* 



in which > 1. But X = ^iX* = \fifx and W = f^-^W* = \n\^^W, so 



X = 0. Moreover, Z = fiY*, so Ajj has the form 

If 21 = UAU* = VAV* and both U and ^ are unitary, then A (C/*F) = 
(/7*y)A, so the unitary matrix U*V is block diagonal and conformal to A. 
Thus, in the presentations corresponding to U and to corresponding 
diagonal blocks are unitarily *congruent. ■ 

Theorem 5.5 Let A G Af„. T/ie following are equivalent: 

(a) is normal. 

(b) A (AA*) = {A* A) A, that is, A^A* = A*A^. 

If A is nonsingular, then (a) and (b) are equivalent to 

(c) A^*A is normal. 

Proof, (a) =4' (b): Consider the identity 

(A^) A^A (A^) . 
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Since is normal, Lemma ICT a) ensures that 
and hence 

A'^A* = A {AA*) = {A* A) A = A*A'^. 

(b) =^ (a): Assuming (b), we have 

A^ {AY ^ (A^A*) A* = {A*^^) A* = A* (A^A*) 
= A* {A*A^) = {A* f A^ = {A^A^ 

(c) => (b): The identity A = {A^* A)* A{A^* A) is equivalent to 

{A-*A)-*A^ A{A-*A). (22) 
Since AA^* is normal, Lemma BTT b) ensures that 

{A-*A)A = {{A-*A)-*y* A = A{A-*A)-*, 
which implies that A^*A^ = A^A^* and A^A* = A*A^. 

(b) (c): Assuming (b), we have AAA* — A*AA, which is equivalent to 
A A* A* =A*A*A and (since A is nonsingular) to 

A-*AA* = A*AA-*, 

The inverse of this identity is 

A-*A-^A* = A*A-^A-*. 

Now compute 

{A-*A){A-*Ay = {A-*AA*)A-^ = {A*AA-*)A-\ 

which is Hermitian, so 

{A-*A){A-*Ay = {A*AA-*A-^y = {A-*A-^A*)A 
= {A*A-^A-*) A = {A-*A)*{A-*A). 



Theorem 5.6 Let A G Mn be nonsingular. If A^ is normal, then A is unitarily 
*congruent to a direct sum of blocks, each of which is 



[A] 



1 




A, M e C, A 7^ 0, r > 0, < l/^l < I. (23) 



This direct sum is uniquely determined by A, up to permutation of its blocks. 
Conversely, if A is unitarily *congruent to a direct sum of blocks of the form 
then A^ is normal. 
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Proof. Normality of implies normality of its *cosquare A~*A, so A is 
unitarily ^congruent to a direct sum of the form (jl9p . and the unitary *congru- 
ence class of each summand is uniquely determined hy A. It suffices to consider 
the two types of blocks that occur in (fTO|) : (a) a unimodular scalar multiple of 
a Hermitian matrix Hk, and (b) a block of the form ([^0)1 . 

(a) The spectral theorem ensures that there is a unitary Vk € and a real 

nonsingular diagonal Lk G such that 7ik = VkLkV^. The diagonal entries 

of afcLfc (that is, the eigenvalues of akHk = Ak) are unitary *congruence in- 
variants of Ak, so they are uniquely determined by A] they all lie on the line 
{tak ■ — oo < t < oo}. The diagonal entries of aiLi, . . . , UpLp are the source of 
aU the 1-by-l blocks in ((23|) . 



(b) Consider a block of the form 

A,-- 











in which Yj G M„^ is nonsingular. The singular value decomposition ensures 
that there are unitary Vj , Wj G Mn- and a positive diagonal matrix = 



diag(T}-'^ , . . . , tA-^O such that Y, 



Then 



VjT.jW* ' 




■ 







■ 




■ 
















MjSj 










Aj — 



is unitarily ^congruent to 



MjSj 

which is unitarily ^congruent (permutation similar) to 



i=l 







> 0. 



^j. Given 7^ 0, 



are determined by the eigenvalues of A^, which are 



These blocks contribute Uj 2-by-2 blocks to (|23|) , all with ^ 
the parameters , . . . , r, 
invariant under unitary *congruence of Aj. 

Conversely, if A is unitarily *congruent to a direct sum of blocks of the two 
types in ()23p . then A^ is normal since it is unitarily ^congruent to a direct sum 
of diagonal blocks of the two types [A^] and T^/i/2. ■ 



6 Unitary regularization 

The following theorem describes a reduced form that can be achieved for any 
singular nonzero matrix under both unitary congruence and unitary '''congru- 
ence. It is the key to separating a singular nonzero matrix into a canonical 
direct sum of its regular and singular parts under unitary congruence or unitary 
*congruence. 
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Theorem 6.1 Let A G Af„ be singular and nonzero, let mi he the nullity of 
A, let the columns of Vi be any orthonormal basis for the range of A, let the 
columns of V2 be any orthonormal basis for the null space of A* , and form the 
unitary matrix V = [Vi V2] ■ Then 

(a) A is unitarily congruent to a reduced form 



(24) 



A' 


B 







C 


D 


[S 0] 


}m2 







}mi 



in which TO2 = m-i - dim {N{A) n 7V(A^)); if m2 > then D G Mm^- ^ = 
diag(cri, . . . , tTm^), and all at > 0; if mi + m2 < n, then A' is square and [A' B] 
has linearly independent rows; the integers mi, TO2 o.nd the unitary congruence 
class of the block 

A' B ' 
C D 

are uniquely determined by A. The parameters cri , . . . , cr„i2 o'^s the positive 
singular values ofViAV2, so they are also uniquely determined by A. 

(b) A is unitarily *congruent to a reduced form p3) in which 7712 ~ mi — 



(25) 



d\m[N{A) n N{A*)); 1/7712 > then D G M^a, S = diag(ai, . . . jCTmJ, and all 
Ui > 0; if mi + m2 < n, then A' is square and [A' B] has linearly independent 
rows; the integers mi, 7712 and the unitary *congruence class of the block i25\) are 
uniquely determined by A. The parameters cti, . . . , (7^2 fl'^e the positive singular 
values ofViAV2, so they are also uniquely determined by A. 



Proof. We have 



V*A 



' Vi*A ' 




■ Vi*A ' 


V2*A 








The next step depends on whether we want to perform a unitary congruence or 
a unitary *congruence. 

(a) Let N — V{AV2 and form the unitary congruence 



v*A{v*y 



Vi*A 






■ Vi*AVi 


Vi*AV2 ' 




' M N ' 















Now let 7^2 = rankiV. 
achieved with A' = M. 



[Vi V2] 



If 7^2 = then iV = and the form ([Mjl has been 
If 7772 > 0, use the singular value decomposition to 



write N = XT12Y* , in which X and Y are unitary, 

and E = diag((Ti, 







and the diagonal entries ai are the positive singular values of N. 
X* © and form the unitary congruence 



Let 



(26) 

Z = 



Z {V*AV) Z^ 



X*MX 




X*NY 



" A' 


B 





C 


D 


[S 0] 








}?772 
}r77l 
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The block X*MX has been partitioned so that D E Mm^. Finally, inspection 
of dMl) shows that dim(7V(A) n N{A^)) = mi - m2. 

Suppose that R,R,Ue M„, U is unitary, and R — URU'^ , so R and R have 
the same parameters mi and m2. Suppose 





' A' B 







' M. B 







R = 


C D 


[S 0] 


}m2 and i? — 


C D 




}m2 , 









}mi 







}mi 


partition U = 




SO that ?7ii e M„_„ij and C/22 e M„ii, and partition 



R = 







}mi 



in which 



has full row rank. Then 



Z = 



A! B 

C D [SO] 



★ 





^RU = UR = 



* 

U21Z 



so U21 — 0. Lemma [4. 2f a) ensures that U12 = as well, so J7 = Uu © U22 and 
both direct summands are unitary. Then 







'A' B ' 







R = 




C D 




_ [S 0] _ 







Orni 



URU' 



Uu 



K B 
C D 






[SO] 



and the uniqueness assertion follows. 

(b) Let N = V{AV2 and form the unitary * congruence 

V{A 



v*A{v*y 



V2*A 





■ V^AVi 


V,*AV2 ' 




' M N ' 







Omi 








Let 1712 = rankA^. If TO2 = then = and the form has been achieved 
with A' = A/. If 7712 > 0, use the singular value decomposition to write N = 
XE2F*, in which X and Y are unitary, S2 has the form ([^5]) . and the diagonal 
entries Ci are the positive singular values of N. Let Z = X* Y* and form the 
unitary *congruence 



Z{V*AV) Z* = 



X*MX X*NY 







0„ 



A' 


B 





C 


D 


[S 0] 





Omi 



}"^2 
}mi 
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The block X*MX has been partitioned so that D E Mm^. The uniqueness 
assertion follows from an argument parallel to the one employed in (a). ■ 

We are concerned here with only the simplest cases of unitary congruence 
and *congruence, and the preceding theorem suffices for our purpose; a general 
sparse form that can be achieved via unitary congruence and *congruence is 
given in [T^ Theorem 6(d)]. 

Corollary 6.2 Let A £ Af„ be singular and nonzero. Let mi he the nullity of 
A, let the columns of Vi be an orthonormal basis for the range of A, let the 
columns of V2 be an orthonormal basis for the null space of A* , and form the 
unitary matrix V = [Vi V2] . 

(a) Suppose A is congruence normal. Then it is unitarily congruent to a direct 
sum of the form 

®0rm-m2, 'y,>0, (27) 

in which A' is either absent or it is nonsingular and congruence normal; m2 = 
rank j4— rank = rankVi AV2; and the parameters cti, . . . , the positive 

singular values ofViAV2. The unitary congruence class of A' , m2, cri,. • Cm^; 
and mi are uniquely determined by A. 

(b) Suppose A is squared normal. Then it is unitarily *congruent to a direct sum 
of the form {21^ , in which A' is either absent or it is nonsingular and squared 
normal; m2 = rank A — rank = rank V* AV2 ; and the parameters cri , . . . , CTm^ 
are the positive singular values ofViAV2. The unitary *congruence class of A' , 
m2, <Ji,. . ., cr„2, and mi are uniquely determined by A. 

Proof. Combine Lemma HT^ b) with Theorem l6.1l ■ 

The matrix A' in (|27p is the regular part of A under unitary congruence 
(respectively, unitary ^congruence); the direct sum of the singular summands 
in (|27[) is the singular part of A under unitary congruence (respectively, unitary 
*congruence) . 



A' © 0a, 



7 Canonical forms 



We have now completed all the steps required to establish canonical forms for 
a conjugate normal matrix A under unitary congruence, and a squared normal 
matrix A under unitary *congruence: First apply the unitary regularization 
described in CoroUarv 16.21 to obtain the regular and singular parts of A, then 
use Theorems 15.31 and 15.61 to identify the canonical form of the regular part. 



Theorem 7.1 Let A e Lf AA is normal, then A is unitarily congruent to 
a direct sum of blocks, each of which has the form 

] 



or T 



(7, r e M, cr > 0, r > 0, /i e C, and /i 7^ 1- 



(28) 
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This direct sum is uniquely determined by A up to permutation of its blocks and 
replacement of any parameter iJ, by . Conversely, if A is unitarily congruent 
to a direct sum of blocks of the form h28\) . then AA is normal. 



Proof. The unitary congruence regularization (|27p reveals two types of 
singular blocks 

' 1 




[0] and 7 



7>0, 



(29) 



while Theorem 15.31 reveals two types of nonsingular blocks 



and 



1 
^i 



a > 0, T > 0, and 7^ /i ^ 1. 



(30) 



Theorem 7.2 Let A E Mn. If A^ is normal, then A is unitarily *congruent to 
a direct sum of blocks, each of which is 



[A] 



1 
H 



r e 



> 0, and 1^1 < 1. 



(31) 



This direct sum is uniquely determined by A, up to permutation of its blocks. 
Conversely, if A is unitarily *congruent to a direct sum of blocks of the form 
i31\) . then A^ is normal. 



Proof. The unitary ^congruence regularization (|24p reveals the singular 
blocks and Theorem l5.6l reveals the nonsingular blocks. ■ 

For some applications, it can be convenient to know that the 2-by-2 blocks 
in pip may be replaced by canonical upper triangular blocks. The set 



I?+ := {z e C : Re z > 0} U {ii : t e R and t > 0} 



(32) 



has the useful property that every complex number has a unique square root in 
T>+. We use the following criterion of Pearcy: 

Lemma 7.3 (|20j) Let X,Y E M2. Then X and Y are unitarily *congruent 
if and only if tr X = trY, tr X^ = tiY^, and trX*X = trY*Y. 

Theorem 7.4 Let A G A/„. If A^ is normal, then A is unitarily *congruent to 
a direct sum of blocks, each of which is 



[A] or 



\,v E C, r e K, r > 0, and 1^ eV+. 



(33) 



This direct sum is uniquely determined by A up to permutation of its blocks. 
Conversely, if A is unitarily *congruent to a direct sum of blocks of the form 
Ji33jl . then is normal. 
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Proof. It suffices to sliow that if t > and \fi\ < 1, and if we define 



and 
then 



ly := Ty^ e X>+ 
r-:=T(l-|M|): 



(34) 
(35) 



V r 
-V 



and 6*2 '.— t 



1 




are unitarily ^congruent. One checks that 

trCi = = trC2, 
tr Cl = = 2tV = tr C|, 

and 

tr Ci*Ci 2 li/p + = + (1 - = + r^/i^^ ^ tr C2*C2, 

so our assertion follows from Lemma 17.31 



8 Beyond normality 

We conclude with several results involving unitary congruence and unitary *con- 
gruence. 

8.1 Criteria for unitary congruence and *congruence 

To show that two matrices are unitarily congruent (or unitarily *congrucnt), in 
certain cases it suffices to show only that they are congruent (or *congrucnt). 

Theorem 8.1 Let A,B,S G A/„ be nonsingular and let S — WQ be a right 
polar decomposition. Then 

(a) A and B are unitarily congruent if and only if the pairs {A,A^*) and 
{B,B-*) are congruent. In fact, if {A, A-*) = S{B,B-*)S^, then {A, A-*) = 
W{B,B-*)W^. 

(b) A and B are unitarily *congruent if and only if the pairs {A^A~*) and 
{B,B''*) are *congruent. In fact, if {A, A-*) = S{B,B-*)S*, then {A, A-*) = 
W{B,B-*)W*. 

Proof. Let Ai > • • • > > be the distinct eigenvalues of S*S and let 
p(t) be any polynomial such that p{Xi) — +Ay^ and p{X~^) = +A~^^^ for each 
i — 1, . . . , d. Then Q — p{S*S) is Hermitian and positive definite, = S*S, 
andQ-^ =p{{S*S)-^). 

(a) If there is a unitary U such that A — UBU^, then 



{A,A- 



{UBU' , UB-*U' ) = U{B, B~*)U' 
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Conversely, if {A, A'*) = S{B,B-*)S'^, then 

SBS'^ = A= {A-*y* = {SB-*S'^)~* = S-*BS-\ 

so 

{S*S)B = B{S*S)-^ . 

It follows that 

giS*S)B = Bg{{S*Sy^f 
for any polynomial g{t). Choosing g{t) = p{t), we have 

QB = p{S*S)B = Bp{{S*S)-Y = BQ-'^, 
so QBQ'^ = B and 

A = SBS^ = WQBQ^W'^ = WBW'^. 
(b) If there is a unitary U such that A = UBU* , then 

{A, A-*) = {UBU'^ ,UB-*U*) = U{B,B-*)U*. 
Conversely, if {A, A'*) = S{B,B-*)S*, then 

SBS* =A = {A-*y* = {SB-*S*y* = S-*BS-\ 

so 

{s* s) B = B {s* sy'^ 

and hence 

g{S*S)B = Bg{{S*Sy^) 
for any polynomial g{t). Choosing g{t) = p{t), we have 

QB = p{S*S)B = Bp{{S*Sy'^) = BQ-\ 

so QBQ = QBQ* = B and 

A = SBS* = WQBQ*W* = WQBQW* = WBW*. 

■ 

Corollary 8.2 Let A,B e Mn be given. 

(a) If A and B are either both unitary or both coninvolutory, then A and B are 
unitarily congruent if and only if they are congruent. 

(b) If A and B are either both unitary or both involutory, then A and B are 
unitarily *congruent if and only if they are *congruent. 
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Proof. The key observation is that A *= A if A is unitary, A * = if 
A is coninvolutory, and A~* = A* ii A is involutory. 

(a) Suppose A ~ SBS'^ . If A and B are unitary, then 

{A, A-*) = {A, A) = {SBS^,SBS^) = S{B,B)S^ = S{B,B-*)S^, 

so Theorem 18. If a) ensures that A is unitarily congruent to B. If A and B are 
coninvolutory, then 

{A, A-*) = iA,A'^) = {SBS^,SB^S'^) = S{B,B'^)S^ ^ S{B,B-*)S'^, 

so A is again unitarily congruent to B. 

(b) Suppose A = SBS*. If A and B are unitary, then 

{A,A~*) = {A, A) ^ {SBS*, SBS*) = S{B,B)S* = S{B,B-*)S*, 
so A is unitarily *congruent to B. If A and B are involutory, then 

{A, A-*) = {A, A*) = {SBS*,SB*S*) ^ SiB,B*)S* = S{B,B-*)S*, 
so A is unitarily congruent to _B. ■ 

8.2 Hermitian cosquares 

Theorem 8.3 Suppose that A G Af„ nonsingular. The following are equiva- 
lent: 

(a) A^'^ A is Hermitian. 
(h) AA is Hermitian. 

(c) A is unitarily congruent to a direct sum of real blocks, each of which is 

a>0, T>0, fi£M.,0^ fi^l. (36) 

This direct sum is uniquely determined by A, up to permutation of its blocks 
and replacement of any fi by Conversely, if A is unitarily congruent to a 

direct sum of blocks of the form I136\) . then AA is Hermitian. 

Proof. A^'^A is Hermitian if and only if 

A-^A^ {A-^ A)* ^ A* A-^ 

if and only if 

AA = A^A* = (AA)* 

if and only if AA ~ AA is Hermitian. The canonical blocks are the same 
as those in with the restriction that /i must be real. ■ 

Any coninvolution A satisfies the hypotheses of the preceding theorem: 
AA^L 
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[a] or T 



1 
fi 



Corollary 8.4 Suppose that A G M„ and AA = I . Then A is unitarily con- 
gruent to 



In~2q ffl 



cr 



aj > 1, 



(37) 



in which ai, o'^^ , . . . ^CTq, a^^ are the singular values of A that are different from 
1 and each Uj > 1. Conversely, if A is unitarily congruent to a direct sum of 
the form {31^ , then A is coninvolutory. Two coninvolutions of the same size 
are unitarily congruent if and only if they have the same singular values. 

Proof. AA is Hermitian, so A is unitarily congruent to a direct sum of 
blocks of the two types But AA = I, so a ~ 1 and r^fj, — 1. Then 

T = (rpi)"\ so 



T 


■ 


1 ■ 











. 












which has singular values 




and 




-1 





The general case is obtained by specializing Theorem 17. II 

Theorem 8.5 Let A e M„ and suppose that AA is Hermitian. Then A is 
unitarily congruent to a direct sum of blocks, each of which is 



[a] or T 



1 
H 



(38) 



This direct sum is uniquely determined by A up to permutation of its blocks and 
replacement of any (real) parameter pi by Conversely, if A is unitarily 

congruent to a direct sum of blocks of the form then AA is Hermitian. 



8.3 Unitary cosquares 

Theorem 8.6 Suppose that A e Af„ is nonsingular. The following are equiva- 
lent: 

(a) A~^ A is unitary. 

(b) A is conjugate normal. 

(c) A is unitarily congruent to a direct sum of blocks, each of which is 



1 




A9 



, CT, r, 6* e K, o- > 0, T > 0, < 61 < TT. 



(39) 



This direct sum is uniquely determined by the eigenvalues of AA, up to permu- 
tation of its summands. If A is unitarily congruent to a direct sum of blocks of 
the form i39\) . then A is conjugate normal. 
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Proof. A ^ A is unitary if and only if 



A'^A^ = {A-^Ay = [A-^Ay = A*A-^ 



if and only if 



AA* ^ A' A^ A* A. 



The canonical blocks ([55)1 follow from (fTBl) by specialization. 

The eigenvalues of A A are of two types: positive eigenvalues that correspond 
to squares of blocks of the first type in and conjugate pairs of non-positive 



(but possibly negative) eigenvalues {r^ 



} that correspond to blocks of 



the second type with Q < 9 < n. Thus, the parameters cr, r, and e of the 
blocks in (|39p can be inferred from the eigenvalues of AA. ■ 

The unitary congruence canonical blocks (j39p for a conjugate normal matrix 
are a subset of the canonical blocks ((28|) for a congruence normal matrix; the 2- 
by-2 singular blocks are omitted, and the 2-by-2 nonsingular blocks are required 
to be positive scalar multiples of a unitary block. This observation shows that 
every conjugate normal matrix is congruence normal. Moreover, examination 
of the canonical blocks of a conjugate normal matrix shows that it is unitarily 
congruent to a direct sum of a positive diagonal matrix, positive scalar multiples 
of unitary matrices (which the following corollary shows may be taken to be 
real), and a zero matrix. Thus, a conjugate normal matrix is unitarily congruent 
to a real normal matrix. 

If A itself is unitary, then its cosquare A~'^ A = AA is certainly unitary, 
so the unitary congruence canonical form of a unitary matrix follows from the 
preceding theorem. Of course, the eigenvalues of the cosquare of a unitary 
matrix are all unimodular and are constrained by the conditions in ([2|): any 
eigenvalue fJ. ^ 1 (even /i = — 1) occurs in a conjugate pair {/i,/2}. 

Corollary 8.7 Suppose that U G M„ is unitary. Then U is unitarily congruent 
to 

"'01 



In-2q ffi 



flj 



(40) 



in which fj,i, fli, . . . , ^q, p,q are the eigenvalues of UU that are different from 1. 
If fJ,j — e*^^ , then each unitary 2-by-2 block H2{e^^^ ) in |^0| ) can he replaced by 
a real orthogonal block 

'a 13 ' 



-(3 a 



in which a — cos(0/2) and (3 = sin(0/2), or by a Hermitian unitary block 



n2{e) 



e 

.10/2 Q 



(41) 



(42) 



Thus, U is unitarily congruent to a real orthogonal matrix as well as to a Her- 
mitian unitary matrix. 
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Proof. U~'^U — UU so the parameters /i in ([5^ correspond to the pairs 
of unimodular conjugate eigenvalues of UU. Since each block in ((39)) must be 
unitary, the parameters a and r must be +1. One checks that the cosquares 
of i?2(e*^j ) and Q2{S) (311) (both unitary) have the same eigenvalues (namely, 
giiSj-j^ so they are similar. Theorem I3.2f a) ensures that if2(e**^ ) and Q2{d) 



are congruent, and Corollary I8.2r a') ensures that they are actually unitarily 
congruent. The unitary congruence 









-ie/i 



1 

e''» 



e~^»/4 





aie/2 



-ie/2 




shows that the 2-by-2 blocks in (|^0)) may be replaced by Hermitian blocks of 
the form ^2(0). ■ 

In order to state the general case of Theorem 18. 61 we need to know what the 
singular part of a conjugate normal matrix is, after regularization by unitary 
congruence. 

Lemma 8.8 Let A G M„ be singular and conjugate normal; let mi be the 
nullity of A. Then 

(a) The angle between Ax and Ay is the same as the angle between A^x and 
A^y for allx,yeC'\ 

(b) \\Ax\\ = \\A^x\\ for all x G C"; 

(c) N{A) = N{A^); and 

(d) A is unitarily congruent to A'®Qrni in which A' is nonsingular and conjugate 
normal. 

Proof. Compute 

[AxfiAy) = x*A*Ay = x*XFy = [A^x)*{A^y)- 

when X = y we have ||v4a::||^ = llA-^'a;!!^. In particular. Ax = if and only if 
A^x = 0. 

In the reduced form (l24l) of A we have 



m2 = dim N{A) - dim{N{A) n N{A^)) = dim N{A) - dim N{A) = 0. 

Thus, A is unitarily congruent to A' 0™^; A' is nonsingular and its unitary 
congruence class is uniquely determined; and 



{A')* A' ® 0„H = A* A = AA* = A' {A') 
so A' is conjugate normal. 



'0„ 
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Corollary 8.9 Let A G M„ and suppose that A is conjugate normal. Then A 
is unitarily congruent to a direct sum of blocks, each of which is 



[a] or T 







cr,T,e eR, a>0, T > 0, < 9 <Tr. 



(43) 



This direct sum is uniquely determined by the eigenvalues of AA, up to permu- 
tation of its blocks: there is one block y^i?2(e*^) (with yTp > Oj corresponding 
to each conjugate eigenvalue pair {pe*^, pe~'^} of AA with p > and < 6 < tt; 
the number of blocks [a] with a > equals the multiplicity of a as a (positive) 
eigenvalue of AA, so the total number of blocks of this type equals the number 
of positive eigenvalues of AA; the number of blocks [0] equals the nullity of A. 

If B £ Mn is conjugate normal, then A is unitarily congruent to B if and only 
if AA and BB have the same eigenvalues. 

Each unitary block H2{e^^) in ^3\ ) can be replaced by a real orthogonal block 

a P 
-P a 

If A is unitarily congruent to a direct sum of blocks of the form then A is 

conjugate normal. 



a = cos(6'/2) and (3 = sin(6'/2). 



8.4 Hermitian *cosquares 

Theorem 8.10 Suppose that A G M„ is nonsingular. The following are equiv- 
alent: 

(a) A^*A is Hermitian. 

(b) A^ is Hermitian. 

(c) A is unitarily * congruent to a direct sum (uniquely determined by A up to 
permutation of summands ) of blocks, each of which is 



v] , or T 



1 




A,i',^ e M, A 7^ 7^ i^, T > 0, < < 1. (44) 



If Hi, Hi^ , . . . , fiq, liq^ are the (real) eigenvalues of A^*A that are not equal to 
±1 and satisfy < \fij\ < 1 for j = 1, . . . , g, and if A^*A has p eigenvalues 
equal to +1, then the unitary *congruence canonical form of A has p blocks of 
the first type in n — 2q — p blocks of the second type, and q blocks of the 

third type. 

Proof. A^*A is Hermitian if and only if 

A-*A^ {A-*Ay ^ A*A-^ 

if and only if 

A^ = {A^y. 

The canonical blocks (|44l) follow from ((23|) by specialization. ■ 
Any involutory matrix satisfies the hypotheses of the preceding theorem. 
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Corollary 8.11 Let A E Mn, suppose that = I, and suppose that A has 
p eigenvalues equal to 1 . The singular values of A that are different from 1 
occur in reciprocal pairs: fxi, erf ^, . . . ,aq,a^^ in which each ai > 1. Then A is 
unitarily *congruent to 



I, 



7i—p—q 





(To 



-1 1 



> 1 



(45) 



as well as to 



I, 



p-q 



n—p — q 



-1 



(46) 



Conversely, if A is unitarily *congruent to a direct sum of either form 
or {4^6^ , then A is an involution and has p ~ q eigenvalues equal to 1. Two 
involutions of the same size are unitarily *congruent if and only if they have 
the same singular values and +1 is an eigenvalue with the same multiplicity for 
each of them. 

Proof. Since A — A^^ ^ A^*A — A* A and the eigenvalues of the *cosquare 
are just the squares of the singular values of A; the eigenvalues of the *cosquare 
A* A that are not equal to 1 must occur in reciprocal pairs. Let cti, . 
the singular values of A that are greater than 1. Each 2-by-2 block in 
the form 

1 

which has singular values Tjcr| and Tj-; they are reciprocal if and only if tj — i^J^ ■ 
Each 2-by-2 block contributes a pair of eigenvalues ±1, which results in the 
asserted summands Ip-q ® {—In-p-q) since all of the eigenvalues of A are ±1. 

To confirm that A is unitarily *congruent to the direct sum (|46)) . it suffices 
to show that 



aq be 
has 



(T 

-1 



and 6*2 



1 cr-J 

cr 



are unitarily *congruent. Using Lemma l7.3l it suffices to observe that 

trCi = = trCa 
trCi^ = 2 = trC2^ and 
tr Ci*Ci =a^+ a-^ = tr C2*C2 



The general case is obtained by specialization of Theorems 17.21 and 17.41 

Theorem 8.12 Let A G Af„ and suppose A^ is Hermitian. Then A is unitarily 
*congruent to a direct sum of blocks, each of which is 



[A] , [iX] , or T 



1 
/i 



A,^,r e M, r > 0, - 1 < /i < 1. 



(47) 
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[A] , [iX], or 



Alternatively, A is unitarily *congruent to a direct sum of blocks, each of which 
is 

-T^L 

in which the parameters t and /i satisfy the conditions in |^7| j. 

8.5 Unitary *cosquares 

Theorem 8.13 Suppose A e M„ is nonsingular. The following are equivalent: 

(a) A^*A is unitary. 

(b) A is normal. 

(c) A is unitarily *congruent to a direct sum of blocks, each of which is 

[X], A e C, A ^ 0. (48) 
Proof. A^*A is unitary if and only if 

A-^A* = {A-*Ay^ ^ {A-*A)* ^ A*A-^ 

if and only if 

AA* ^ A* A. 

The canonical blocks (|48|) follow from ((23|) by specialization. ■ 

8.6 Projections and A-projections 

The unitary ^congruence regularization algorithm described in Theorem 16. iT b) 
permits us to identify a unitary *congruence canonical form for A-projections, 
that is, matrices A € M„ such that A^ = XA. A 1-projection is an ordinary 
projection, while a nonzero 0-projection is a nilpotent matrix with index 2. A 
complex matrix whose minimal polynomial is quadratic is a translation of a 
A-projection. 

Theorem 8.14 Let A £ Mn be singular and nonzero, let X € C be given, and 
suppose that A? = XA. Let mi be the nullity of A and let ti, . . . , be the 
singular values of A that are strictly greater than \X\ (m2 = is possible). Then 

(a) A is unitarily * congruent to 



A/n — mi— m2 ® 



A ^rf-\X\^ 




®Qm^-m^. (49) 



This direct sum is uniquely determined by X and the singular values of A, which 
are ti, . . . , Tm^, |A| with multiplicity n — mi — m2, and with multiplicity mi. 

(b) For a given X, two X-projections of the same size are unitarily *congruent 
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if and only if they have the same rank and the same singular values. 

(c) Suppose Q ^ A ^ \I and let v = min{mi,n — m{\. Then v > Q and the v 
largest singular values of A and A~ XI are the same. In particular, the spectral 
norms of A and A — XI are equal. 

Proof, (a) Let F denote a reduced form (|24p for A under unitary *congru- 
ence, which is also a A-projection. Compute 





' A' 


B 





2 


" * 


* 


B[T.O 




C 


D 


[E 0] 




* 


* 


D [T. 























and 



XF = 



★ ★ 

* ★ A[EO] 







Since the block [S 0] has full row rank, we conclude that B — and D — XIm2 ■ 
Moreover, A' must be nonsingular because [A' B] has full row rank. Now 
examine 

A' U U ^ 

F2 



A' 








C 


XIm-2 


[E 











[A') 
' + 




CA' + AC X^Im^ A [E 0] 







0„ 



and 



AF 



XA' 
AC A^/,„2 






A[E 0] 
0„,„ 



so that [A') XA' (and A' is nonsingular), and CA' + AC = AC. The first 
of these identities tells us that A' = XIn-mi-m2: a-^d the second tells us that 
C = 0. Thus, A is unitarily *congruent to 

XL 



Xln- 



-r„. [E 0] 

0™, 



, E = diag(CTi, . . . , cr^J, all ai > 0, 



which is unitarily ^congruent (permutation similar) to 

™2 r 



A ai 




(b) The singular values of the 2-by-2 blocks are and = ^J~\X^^r~^ > |A|, so 



(c) A — XI is unitarily ^congruent to 



-'n— m2 — m 



1 ® ^ 



a, 
-A 



© (-A)/™i- 
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so its singular values are: ri , . . . , r,„2 , | A| with multiplicity mi — 7712, and with 
multiplicity n — mi. ■ 



Let q{t) = (t— Ai)(t— A2) be a given quadratic polynomial (possibly Ai = A2). 
If q{t) is the minimal polynomial of a given A G Mn, then q{A) = 0, A — Xil is 
a A-projection with A := A2 — Ai, and A is not a scalar matrix. Theorem 18. 141 
gives a canonical form to which A — Xil (and hence A itself) can be reduced by 
unitary *congruence. 

Corollary 8.15 Suppose the minimal polynomial of a given A G Af„ has degree 
two, and suppose that Ai,A2 are the eigenvalues of A with respective multiplic- 
ities d and n — d; if Ai = A2, let d = n. Suppose that |Ai| > IA2I and let 
Ui, . . . , cFrn be the singular values of A that are strictly greater than |Ai| (m = Q 
is possible). Then: (a) A is unitarily * congruent to 

© X2ld^m, (50) 

in which each 

l^ = y^(T2 + |A,A2|2ar2_|Ai|2_|A2|2 > 0. 

The direct sum 150)) is uniquely determined, up to permutation of summands, 
by the eigenvalues and singular values of A. The singular values of A are 
(Ti,...,(Tm, |AiA2|(Tj"^, . . . , |AiA2|i7^^, |Ai| With multiplicity u — d — m , and \X2\ 
with multiplicity d ~ m. 

(b) Two square complex matrices that have quadratic minimal polynomials are 
unitarily *congruent if and only if they have the same eigenvalues and the same 
singular values. 

Proof. If A is singular, then A2 = 0, A is a Ai-projection, and the validity 
of the assertions of the corollary is ensured by Theorem 18.141 

Now assume that A is nonsingular. The hypotheses ensure that A — Xil 
is singular and nonzero, and that it is a A-projection with A := A2 — Ai. It is 
therefore unitarily *congruent to a direct sum of the form (|49p with mi = d and 
m = m2; after a translation by Ai/, we find that A is unitarily ^congruent to a 
direct sum of the form (|5(I)) in which each 7, = (rf - |A|^)i/2 > 0. Therefore, A 
has n — d — m singular values equal to |Ai| and d ~ m singular values equal to 
IA2I. In addition, corresponding to each 2-by-2 block in (|50p is a pair of singular 
values {(Ji,pi) of A such that 

a, > Pt > and a^pi = IA1A2I (51) 

for each i = 1, . . . ,m. Since the spectral norm always dominates the spectral 
radius, we have cr^ > |Ai| for each z = 1, . . . , m; calculating the Frobenius norm 
tells us that 

'^f +P? = |AiP + |A2p + 7-. 



Xlln-d-r. 



Ai 7i 
A2 
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If CTi = |Ai| then ([?T|) ensures that pi = IA2I, which is impossible since 7^ > 0. 
Thus, A has m singular values cti, . . . ,cfm that are strictly greater than |Ai|, 
and m corresponding singulcir Vcl1ii6S p\ , . . . , p^a that are strictly less than |Ai|; 
each pair {ai,pi) satisfies ([?T|) . Thus, the parameters ji in ([50)1 satisfy 

7.^ = + - lAiP - = + V - |Aip - \X,\\ 

If two complex matrices of the same size have quadratic minimal polyno- 
mials, and if they have the same eigenvalues and singular values, then each is 
unitarily *congruent to a direct sum of the form (jSOp in which the parame- 
ters Ai, A2, rf, m, and {71, . . . , 7™} are the same; the two direct sums must be 
the same up to permutation of their summands. Conversely, any two unitarily 
*congruent matrices have the same eigenvalues and singular values. ■ 

Letp(t) = t^-2at + b'^ be a given monic polynomial of degree two. Corollary 
18.151 tells us that if p{A) = 0, then A is unitarily *congruent to a direct sum 
of certain special 1-by-l and 2-by-2 blocks. We can draw a similar conclusion 
under the weaker hypothesis that p{A) is normal. 

Proof. 

Proposition 8.16 Let A G A/„ and suppose there are a,b €z C such that N = 
A^ — 2aA + bl is normal. Then A is unitarily *congruent to a direct sum of 
blocks, each of which is 

[A] or 



a + ly r 
a — v 



\,v eC, reM, r > 0, and 1/ € I?+ . 



Proof. A calculation reveals that (A— aJ)^ = N+{a'^ — b)I, which is normal. 
The conclusion follows from applying Theorem l7.4l to the squared normal matrix 
A-al. m 



8.7 Characterizations 

CoroUarv lS. 91 tells us that a conjugate normal matrix is unitarily congruent to a 
direct sum of a zero matrix and positive scalar multiples of real orthogonal ma- 
trices; such a matrix is real and normal. The following theorem gives additional 
characterizations of conjugate normal matrices. 

Theorem 8.17 Let A E Mn and let A — PU — UQ be left and right polar 
decompositions. Let cti > a2 > ■ ■ ■ > (Jd > be the ordered distinct singular 
values of A with respective multiplicities ni, . . . ,71^ (if A — let d = 1 and 
ai = 0)- Let A = S -\- C , in which 5 = (A + A^) /2 is symmetric and C = 
(a — A^^ /2 is skew symmetric. The following are equivalent: 

(a) SC = CS. 

(b) A is conjugate normal. 

(c) Q = P, that is, A = PU = UP. 
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(d) PA = AP. 

(e) There are unitary matrices Wi, . . . , Wd with respective sizes ni, . . . , such 
that A is unitarily congruent to 

uiWi e • • • e OdWd. (52) 

(J) There are real orthogonal matrices Qi, . . . , Qd with respective sizes ni, . . . , 
such that A is unitarily congruent to the real normal matrix 

(TiQi®---®adQd- (53) 
Proof, (a) <^ (b): Compute 

A* A ^{S~C){S + C)^SS + SC~CS~ CC 
AA^ ={S + C){S-C)=SS-SC + CS - CC 
A* A - AA^ = 2{SC- CS) . 

Thus, A* A = lA* if and only if SC = CS. 

(b) (c): li p{t) is any polynomial such that p{af) = (7; for each i = 1, ...,d, 
then Q = p {A* A) and P = p{AA*). If A* A = AA^ then 

Q = p {A* A) = p(AW) = p ((AA*)'^) ^ p {AA*f = P'^ ^P. 

(c) => (d): AP P{UP) = P{PU) = PA. 

(d) ^ (c) : Let P — VAV* in which V is unitary and A is nonnegative diagonal. 
Let W = V*UV. Then 

AP = PUP = iVAV*)U{VAV^) = V{AWA)V'^ 

and 

PA = P'^U = VA^V*U = V{A^W)V'^, 
so AW A = A^W. Lemma ensures that AW = lyA, so 

PU = VAV*UVV^ = VAWV'^ = VWAV'^ = J/VA^^ = UP. 

(c) ^ (e): Suppose P = VAV"*, in which A = (Ti/„^ ® • • • CTd^rid and F is 
unitary, li Q = P then 

A = PC/ = vAv*u = c/v'Ay'^ = c/p = c/g = A 

and hence 

A(v*uv) = (y*;/^) A, 

which implies that the unitary matrix V*UV — W\ ® • • • ® Wd is block diagonal; 
each Wi is unitary and has size n^. Thus, 

U {W^®---®Wd)V'^ 
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and 

A = PU = VAV*U = VAV*V {Wi®---® Wd) 
^V{aiWi®---®crdWd)V^. 

(e) =J> (f): Corollary 18 . 71 ensures that each Wj in ([5^ is unitarily congruent to 
a real orthogonal matrix. 

(f) (a): Let Z denote the direct sum ([55)1 and suppose A = UZU^ for some 
unitary U. Then S = ^U{Z + Z'^)U'^ and C = ^U{Z - Z'^)U'^ , so it suffices 
to show that Z commutes with Z^ . But each Qi is real orthogonal, so 

ZZ'^ = gIQiQI ® • • • © alQdQl = ajln, © • • • ® tT^/„, - Z^Z. 

■ 

For normal matrices, an analog of Theorem l8.17l is the following set of equiv- 
alent statements: 

(a) HK = KH, in which H ^{A + A*)/2 and K ^{A- A*)/{2i). 

(b) A is normal. 

(c) Q = P, that is, A = PU = UP. 

(d) PA = AP. 

(e) A is unitarily *congruent to a direct sum of the form ([52]) . in which ai > 
■ ■ ■ > (Jd > are the distinct singular values of A and Wi , ■ ■ ■ , Wd are unitary. 

The following theorem about conjugate normal matrices is an analog of a 
known result about ^congruence of normal matrices jl6] (and, more generally, 
about unitoid matrices jTHl p. 289]). 

Theorem 8.18 (a) A nonsingular complex matrix is congruent to a conjugate 
normal matrix if and only if it is congruent to a unitary matrix. 

(b) A singular complex matrix is congruent to a conjugate normal matrix if and 
only if it is congruent to a direct sum of a unitary matrix and a zero matrix. 

(c) Each conjugate normal matrix A G A/„ is congruent to a direct sum, uniquely 
determined up to permutation of summands, of the form 

© Qn-r, 0<9j < TT, (54) 

in which r — rank A and there is one block H2 (e*^^ ) corresponding to each 
eigenvalue of AA that lies on the open ray {te^^^ : t > 0}. The summand Ir-2q 
corresponds to the r — 2q positive eigenvalues of A A. 

(d) Two conjugate normal matrices A and B of the same size are congruent if 
and only if for each 6 G [0, tt], AA and BB have the same number of eigenvalues 
on each open ray {te^^ : t > 0}. 



-2q 



'0 
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Proof. Only assertion (d) requires comment. If A is conjugate normal and 
nonsingular, the decomposition (j52p ensures that AA is unitarily similar to (and 
hence has the same eigenvalues as) 



Of course, W and the unitary matrix 



WiWi ® • • • e WdWd 

have the same number of eigenvalues on each open ray {ie*® : t > 0}; this 
number is the same as the number of blocks H2 (e*®^ ) in the direct sum ([54]) . 
The argument is similar if A is singular; just omit the last direct summand 
o-rfWd. ■ 

There is an analog of Theorem 18 . 1 71 for congruence normal matrices. 

Theorem 8.19 Let A e -M„ and let A = PU = UQ be left and right polar 
decompositions. Let A = S + C , in which S = {A + A'^)/2 is symmetric and 
C = {A — A^)/2 is skew symmetric. The following are equivalent: 

(a) SS + CC commutes with SC + CS . 
(h) A is congruence normal. 

(c) AP ^ QA. 

(d) {P,Q,UU} is a commuting family. 

Proof, (a) <^ (b): A computation reveals that the Hcrmitian part of AA is 
SS + CC, while the skew-Hermitian part is SC + CS. Of course, AA is normal 
if and only if its Hermitian and skew-Hermitian parts commute. 

(b) <^ (c) : Theorem 15.21 tells us that if A is congruence normal then A (P) ^ = 
(Q) a, which is the same as A{P^) = {Q^y A, which implies that = 
p{Q'^)'^A for any polynomial p{t). Choose p{t) such that p{t) = +^/t on the 
spectrum of P (and hence also on the spectrum of Q), and conclude that 
AP^ ~ Q'^A, or AP — QA. The converse implication is immediate: 



AP^QA^ A (P) 



(qYa. 



(b) =^ (d): Suppose V is unitary, let A :— VAV'^ , and consider the factors of 
the left and right polar decompositions A ~ VU = UQ. One checks that V = 
VPV*, Q = VQV^, and VUV'^. Moreover, {P,Q,UU} is a commuting 
family if and only if {V, Q,UU} is a commuting family. Thus, if A is congruence 
normal, there is no lack of generality to assume that it is a direct sum of blocks 
of the form (|28|) . Blocks of the first type in (p8)) are 1-by-l, so commutation is 
trivial. For blocks of the second type, the polar factors are 



P = 



1 

ImI 



ImI 
1 



and U = 







so UU = 



JO 
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For both types of blocks, {P, Q, UU} is a diagonal family, so it is a commuting 
family. 

(d) => (b): If {P, Q, UU} is a commuting family, then 

AA = PUUQ = P {UU) Q = {UU) {PQ) 
= P {UU) Q = {PQ) {UU) . 

Since P and Q are commuting positive semidefinite Hermitian matrices, PQ is 
positive semidefinite Hermitian. But UU is unitary without further assump- 
tions, so we have a polar decomposition of AA in which the factors commute. 
This ensures that AA is normal. ■ 

A calculation reveals that if SC = CS then SS + CC commutes with SC + CS, 
and that if PU = UP then {P, Q, IJU} is a commuting family. Thus, Theorems 
18 . 171 and 18 . 1 91 permit us to conclude (again) that every conjugate normal matrix 
is congruence normal. 

For squared normal matrices, an analog of Theorem l8.19l is the following set 
of equivalent statements: 

(a) ij2 _ commutes with HK + KH, in which H = {A + A*)/2 and K = 
{A~A*)/{2^). 

(b) A^ is normal. 

(c) AP = QA. 

(d) {P, Q, U^} is a commuting family. 

Our final characterization links the parallel expositions we have given for 
squared normality and congruence normality. 



A 

A 



(55) 



Theorem 8.20 Let A e Af„ and let 

Then: 

(a) A^ is normal if and only if A is congruence normal. 

(b) A is congruence normal if and only if A? is normal. 

(c) A is normal if and only if A is conjugate normal. 

(d) A is conjugate normal if and only if A is normal. 

(e) AAA^ = A'^AA if and only if A* A^ = A^A*. 
if) A*A^ = A^A* if and only if AAA^ = A^ AA. 

Now suppose that A is nonsingular. Then: 

(g) A^"'" A is normal (respectively, Hermitian, unitary) if and only if A^*A is 
normal (respectively, Hermitian, unitary). 

(h) A~*A is normal (respectively, Hermitian, unitary) if and only if A^"^A is 
normal (respectively, Hermitian, unitary). 
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Proof. Each assertion follows from a computation. For example, (a) follows 
from 

' " 





AA = 



(g) follows from 



and (h) follows from 



A-TA 
A-^A 



A-'A 



A-*A 
A-*A 



Using Theorem I8.20[ we can show that Theorems 15.21 and 15.51 are actually 
equivalent: First apply Theorem 15.51 to A, which tells us that A^ is normal if 
and only if A*A'^ — A^A* if and only if A^*A is normal (if A is nonsingular). 
Theorem 18.201 (b). (f), and (g) now ensure that A is congruence normal if and 
only if AAA^ — A^AA if and only if A~^A is normal (if A is nonsingular). 
Thus, Theorem 15.51 implies Theorem 15.21 The reverse implication follows from 
applying Theorem 15.21 to A and using Theorem 18.201 (a), (e). 



and (h). 

A similar argument shows that the equivalence of Theorem 18.31 (a) and (b) 
(respectively, Theorem l8.6l (a) and (b)) implies and is implied by the equivalence 
of Theorem 18. 101 (a) and (b) (respectively. Theorem 18. 131 fa) and (b)). 



8.8 The classification problem for cubed normals is uni- 
tarily wild 

We have seen that there are simple canonical forms for squared normal matri- 
ces under unitary *congruence, and also for congruence normal matrices under 
unitary congruence. However, the situation for cubed normal matrices under 
unitary *congruence (and for matrices A such that AAA is normal, under uni- 
tary congruence) is completely different; the classification problems in these 
cases are very difficult. 

A problem involving complex matrices is said to be unitarily wild if it con- 
tains the problem of classifying arbitrary square complex matrices under unitary 
*congruence. Since the latter problem contains the problem of classifying an 
arbitrary system of linear mappings on unitary spaces [22l Section 2.3], it is 
reasonable to regard any unitarily wild problem as hopeless (by analogy with 
nonunitary matrix problems that contain the problem of classifying pairs of 
matrices under similarity [2]). 

Two lemmas are useful in showing that the unitary congruence classification 
problems for (a) cubed normal matrices under unitary *congruence, and (b) for 
matrices A such that AAA is normal, are both unitarily wild. 
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Lemma 8.21 Let Xi, . . . ,Xd be given distinct complex numbers and let F, F G 
Mn be given conformally partitioned block upper triangular matrices 

Ai/„i Fi2 ■■■ -Fid 

A2/n2 • • • 
^dlud . 

in which ni + n2 + ■ ■ ■ + rid ^ n. If S €z Af„ and SF — F S , then S is block 
upper triangular conformal to F. If, in addition, S is normal, then S is block 
diagonal conformal to F. 

Proof. Partition S — [Sij]fj^i conformally to F. Compare corresponding 
{i,j) blocks of SF and F S' in the order (d, 1), (d, 2), . . . , (d, d — 1) to conclude 
that each of Sd,i, Sd,2^ ■ ■ • , Sd^d-i is a zero block. Then continue by comparing 
the blocks in positions {d—1, 1), {d—1, 2), . . . , (d— 1, d—2), etc. If S is normal and 
block upper triangular, then Lemma HTW a) ensures that it is block diagonal. ■ 

Lemma 8.22 Let ai > a2 > ■ ■ ■ > (Td > and > > ■ ■ ■ > cr^ > be given 
nonnegative real numbers, let D, D G Af„ be given conformally partitioned block 
diagonal matrices 

in which ni + n2 + ■ ■ ■ + rid ^ n. If U,V (z A/„ are unitary and DU — VD , 
then Ui — fjj for each i — l,...,d, and there are unitary matrices Wi G 
, . . . , Wd-i e M„^_j and U ,V ^ M„^ such that U = Wi®---® Wd-i ® U 
andV = Wi®---® Wd-i ® V; if crd > then U = V. 

Proof. Let A = DU = VD . The eigenvalues of AA* = D'^ and A* A = 
{D )^ are the same, so D = D . Moreover, 

AA* = (DU) (DU)* ^ D^ = VD^V* 

and 

A* A = U*D^U = {VD)* [VD] = D^, 

so D^ commutes with both U and V and hence each of U and V is block diagonal 
conformal to D. The identity DU = VD ensures that the diagonal blocks of U 
and V corresponding to each ai > are equal. ■ 

Theorem 8.23 The problem of classifying square complex matrices A up to 
unitary *congruence is unitarily wild in both of the following two cases: 

(a) A"^ = 0. 

(b) A is nonsingular and A^ is normal. 



F = 



F12 



Fid 

F2d 



F 



D = 



0'2/n 



^dln^ 
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Proof, (a) Let F, F e Mu be given. Define 



Ofc h F 
Ofc Ofc Ik 
Ofe Ofc Ofc 



and A 



Ofc Ik F 
Ofc Ofc h 
Ofc Ofc Ofc 



(56) 



so that A'^ — {AY = for any choices of F and F . Suppose A and A are 
unitarily ^congruent, that is, suppose there is a unitary U — \Uij]^j=i & M^k, 

partitioned conformally to A, such that AU = UX . Then A^U = {uXY\ the 
1, 3 blocks of A^ and {A Y are Ik and all their other blocks are Ofc. Comparison of 
the first block rows and the third block columns of both sides of A^U = [UAY 
reveals that Un — [/as and U^i = U32 — U21 — Ofc. It follows that U is block 
diagonal since it is normal and block upper triangular. Comparison of the 1, 3 
blocks of both sides of AU — UA shows that FU22 — UuF ; comparison of the 
1,2 blocks shows that Uu — 1/22- Thus, A and A are unitarily *congruent if 
and only if F and F are unitarily *congruent. 

(b) Let F, F e Mfc be given. Define the two nonsingular matrices 



A^ 



A/2fc Ai3 
M/3fc G 
hk 



and A — 



13 



Xhk A 
fihk G 
hk 



in which A = (— 1 + i\/3) /2 and /i = A are the two distinct roots of + 1 + 1 = 0, 



G 



3/fc 
2/fc 
h 



A, 



Ik Ik F 
Ofc Ik Ik 



and A 



13 



Ik Ik F 

Ofc Ik Ik 



A computation reveals that A^ = {A)^ = X^hk ® fJ'^hk © hk is diagonal (and 
hence normal) for any choices of F and F . Suppose A and A are unitarily 
*congruent, that is, suppose there is a unitary U — [C/y]fj=i S Msk, partitioned 
conformally to A, such that AU — UA . Lemma 18.211 ensures that U is block 
diagonal. Since 

(AC/) 23 = GU33 ^U22G^ (C/A)23 , 

Lemma [8.22l ensures that U33 = U22 and that C/33 = Vi©V2®V3 is block diagonal 
conformal to G. Partition Un = [Wij]fj^i, in which W\\,W22 G Mfc. Equating 
the 1, 3 blocks of both sides of the identity AU = U A gives the identity 



A13C/: 



13<^33 



IkVl 
Ofc 



y2 
V2 



FV3 
V3 



W21 



Wi2 

W22 



Ik 

Ofc 



Ik 
Ik 



F 
Ik 



UnA 



13- 



Comparison of the 2, 1 blocks of both sides of this identity tells us that W21 = 0, 
so W is block upper triangular and hence W12 = as well. Comparison of the 
2,2 and 2,3 blocks tells us that V2 — W22 — V3 and comparison of the 1,2 
blocks tells us that V2 — Wn. Finally, comparison of the 1,3 blocks and using 
V3 = Wii reveals that FV3 — V3F ,so A and A are unitarily *congruent if and 
only if F and F are unitarily *congruent. ■ 
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Theorem 8.24 (a) The problem of classifying square complex matrices A such 
that AAA — up to unitary congruence contains the problem of classifying 
arbitrary square matrices up to unitary congruence. 

(b) The problem of classifying square complex matrices up to unitary congruence 
is unitarily wild. 



Proof, (a) Suppose the matrices A and A in ([56|) are unitarily congru- 
ent, that is, AU = UA for some unitary U — [Uij]f that is partitioned 
conformally to A. Then 



U31 




t^22 + FU32 
U32 





U23 + FU33 

U33 





Uii UiiF +U12 
U21 U21F' + U22 

C/31 U31F' +tJ32 

(57) 

Comparing the 2, 1 blocks of both sides of ([Ff|) tells us that U31 ~ 0, and then 
comparing the 1, 1 blocks as well as the 3, 3 blocks tells us that U21 ~ U32 = 0. 
Since U is block upper triangular and normal, it is block diagonal. Comparing 
the 1,2 blocks and the 2,3 blocks of (fST]) now tells us that Un — U22 — U33, 
so Uu — U33. Finally, comparing the 1,3 blocks reveals that FUu — UnF , 
that is, A and A are unitarily congruent if and only if F and F are unitarily 
congruent 



(b) Let F,Fe Mk be given and suppose that 



A^ 



Ofc /fc F 

Ofc 4 

Ofc h 

Ofc 



and A ~ 



Ok h F 

Ok h 

Ofc /fc 

Ofc 



are unitarily congruent, that is, AU ~ UA for some unitary U = [Uij]f 
that is partitioned conformally to A. An adaptation of the argument in part (a) 
shows that U is block diagonal, U22 = Uu, U33 — Uu, and D44 = Uu. Hence, 
FUu — UuF . We conclude that A and A are unitarily congruent if and only 
if F and F are unitarily *congruent. ■ 

8.9 A bounded iteration 

Suppose A G Mn is nonsingular and let xo G C" be given. Define xi,X2,. . . by 

^^Xfc.+i +Axfc = 0, fc = 0,1,2,.... (58) 

Under what conditions on A is the sequence xi,X2, . . . bounded for all choices 
of Xo? 

We have 



xfc+i = -A-'^Axk = • • • = (-1)^- {A-'^Af^' xo 
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so boundedness of the solution sequence for all choices of xq requires that no 
eigenvalue of the cosquare A~^A has modulus greater than 1. Moreover, every 
Jordan block of any eigenvalue of modulus 1 must be 1-by-l. Inspection of H]) 
reveals that the Jordan Canonical Form of A~'^A must have the form in 
which each Hj ^ 1 and \iJ,j\ = 1. Theorem l3.2r a') ensures that A is congruent to 
a direct sum of blocks of the two types 

ImI = 1 ^ (59) 

Corollary 18 . 71 ensures that the 2-by-2 blocks in ([55]) may be replaced by 2-by-2 
real orthogonal blocks (|^T|l or by 2-by-2 Hermitian unitary blocks 

Conversely, HA — SU S"^ for some nonsingular S and unitary U, then 

= A^xk+i + Axk = SU^S^Xk+i + SUS^Xk, A: = 1, 2, . . . 

if and only if 

a+i = (-1)'= (UU)"^' ^0, ■■= S^Xk, k = l,2,.... 

The sequence ^Oi^ii ■•■ is bounded since UU is unitary. In summary, we have 
the following 

Theorem 8.25 Let A G Af„ be nonsingular. The following are equivalent: 

(a) The sequence Xi,X2 ■ ■ ■ defined by 

A'^Xk+i+ Axk =0, fc = 0,1,2,... 
is bounded for each given xq G C". 

(b) A is congruent to a unitary matrix. 

(c) A is congruent to a real orthogonal matrix. 

(d) A is congruent to a Hermitian unitary matrix. 

(e) A is congruent to a nonsingular conjugate normal matrix. 

Parallel reasoning using Theorems l3.1f b) and l3.2r b') leads to similar conclu- 
sions about the conjugate transpose version of ((58| . 

Theorem 8.26 Let A G M„ be nonsingular. The following are equivalent: 

(a) The sequence xi,X2. ■ . defined by 

A*Xk+i+ Axk=Q, fc = 0,1,2,... 
is bounded for each given xq G C". 

(b) A is * congruent to a unitary matrix. 

(c) A is diagonalizable by *congruence. 

(d) A is *congruent to a nonsingular normal matrix. 



[1] and 



1 
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9 Some comments about previous work 



Lemma ITlT a) is often called the Fuglede-Putnam Theorem. 

The assertion in Corollary 18. 2r b) that two unitary matrices are *congruent 
if and only if they are unitarily *congruent was proved in |19| with an elegant 
use of uniqueness of the polar decomposition. 

The unitary congruence canonical form (|37p for a coninvolutory matrix was 
proved in [IDI Theorem 1.5]. 

Wigner [25] obtained a unitary congruence canonical form (j40p for unitary 
matrices in which the 2-by-2 blocks are the Hermitian unitary blocks (|^^ . 

In [T] , Autonne used a careful study of uniqueness of the unitary factors in 
the singular value decomposition to prove many basic results, for example: a 
nonsingular complex symmetric matrix is diagonalizable under unitary congru- 
ence; a complex normal matrix is unitarily similar to a diagonal matrix; a real 
normal matrix is real orthogonally similar to a real block diagonal matrix with 
1-by-l and 2-by-2 blocks, in which the latter are scalar multiples of real orthog- 
onal matrices; similar unitary matrices are unitarily similar. Lemma 18.221 is a 
special case of Autonne's uniqueness theorem; for an exposition see [SJ Theorem 
3.1.1']. 

Hua proved the canonical form (|17p for a nonsingular skew symmetric matrix 
under unitary congruence in [141 Theorem 7]; Theorem 5 in the same paper is 
the corresponding canonical form for a nonsingular symmetric matrix. 

The first studies of conjugate normal and congruence normal matrices seem 
to be and [7j. 

The canonical form (|33p for a squared normal matrix (and hence the canon- 
ical form (|3ip ) can be deduced from Lemma 2.2 of 22J). 

Each squared normal matrix can be reduced to the form (|33p by employing 
the key ideas in Littlcwood's algorithm for reducing matrices to canonical 
form by unitary similarity. An exposition of this alternative approach to Theo- 
rem 17. 4[ as well as a canonical form for real squared normal matrices under real 
orthogonal congruences, is in j4j. 

D.Z. Dokovic proved the canonical form ((49|) for ordinary projections (A — 1) 
in [3]; for a different proof see [22l p. 46]. George and Ikramov [6] used D.Z. 
Dokovic's canonical form to derive a decomposition of the form (j46p for an 
involution; in addition, they used Specht's Criterion to prove Corollarv 18 . 1 Sf b V 
For an ordinary projection P, and without employing any canonical form for P, 
Lewkowicz pPf identified all of the singular values of P and I ~ P. 

The block matrix ()55p and the characterization of conjugate normal matrices 
in Theorem I8.20r d) was studied in [5, Proposition 2]. The characterization of 
conjugate normal matrices via the criterion in Theorem 18. 17f a) is in [SJ Propo- 
sition 3]. 

Theorem 18.23( a) was proved in 22, p. 45]. 

In |15j . Ikramov proved that any matrix with a quadratic minimal polyno- 
mial is unitarily ^congruent to a direct sum of the form ([50|l . His characteriza- 
tion of the positive parameters 7^ is different from ours: If Ai 7^ A2, he found 
that J — |Ai — A2I tana, in which a is the angle between any pair of left and 
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right A 1 -eigenvectors of the block 



A2 _ ■ 

This pleasant characterization fails if Ai — X2', our characterization (using eigen- 
values and singular values) is valid for all Ai, A2. 

The authors learned about the bounded iteration problem in Section 18.91 
from Leiba Rodman and Peter Lancaster, who solved it using canonical pairs. 
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